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(54) System and method for packet level restoration of IP traffic using overhead signaling in a 
fiber optic ring network 



(57) An apparatus and a method for forwarding data 
packets through a fiber optic ring network includes for- 
warding data packets on a packet by packet basts. A 
node (300) on the fiber optic ring network decides on a 
packet by packet basis whether to transmit on the work- 
ing or protection path. Because this decision is being 
made on a packet level, reservation of throughput 
resources no longer is made at a one to one ratio. 
Rather, protection path resources are reserved at a ratio 
significantly less than one to one. In one embodiment, 
no resources are reserved for path restoration or pro- 
tection path routing. Rather, quality of service provision- 
ing is used to resolve interference situations wherein 
instantaneous demand exceeds capacity. A node (300) 
evaluates ring conditions in relation to the demand of 
traffic resources and the relative quality of service rat- 
ings to determine whether and how to forward a packet. 
Additionally, a node (300) decides whether to use the 
working (332) or protection path (336) by considering 
the final destination on the fiberoptic ring network, any . 
identified ring conditions and, in some embodiments, 
quality of service. The ring conditions to which the 
inventive nodes respond include OSI layer 1 , layer 2 and 
layer 3 conditions. In alternate embodiments, the node 
. (300) aiso evaluates parameters such as identified or 
assigned quality of service parameters. Whenever a 
layer 1, a layer 2 or a layer 3 condition occurs, a node 
generates an overhead signal within fifteen milliseconds 
of the condition occurring. An ingress node (a node that 
receives IP traffic and places it onto the fiber optic ring 



network) is adapted to effectuate path restoration within 
35 milliseconds of receiving the overhead signal identi- 
fying a failure and within fifty milliseconds of the failure 
condition event. 
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[0001] This application is related to and includes by 
reference the following U.S. patent application in its 
entirety, said application being concurrently filed here- 
with this application: 
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BACKGROUND 



1. Technical Field 

[0002] The present invention relates generally to 
data transmission in fiber optic ring networks, by way of 
example, the synchronous optical networks, (SONET 
networks) and Synchronous Digital Hierarchy networks 
(SDH networks) and more particularly, to the routing of 
IP data packets through the fiber optic ring networks' 
including SONET and SDH networks. 

2. Related Art 

[0003] The recent explosion of the internet is creat- 
ing the capability and desire for networks of all types to 
be integrated and coupled to exchange data signals car- 
rying the varying types of information. In many cases, 
the same data also will also be transported through a 
local area network (LAN) prior to being delivered to the 
internet Thus, by way of example, a digitized signal can 
b transported from a source through a LAN and 
through the internet, to a final destination. Moreover, 
within the internet portion itself, there may be a need to 
transport the user data through a backbone data trans- 
port infrastructure, by way of example, through a fiber 
optic ring network. 

[0004] Generally speaking, the internet is, in 
essence, a collection of many large and small computer 
networks that are coupled together over high speed 
backbone data links such as T-1, T-3, OC-1 and OC-3. 
Stated differently, the internet is a network of networks. 
As a result of the creation of the internet, worldwide 
access may be achieved. People and their equipment 
may now communicate from most any civilized point to 
another in a fast and relatively inexpensive medium. 
[0005] While it is popular to think of the internet as 
one network of networks, there are other such internets 
that are in existence and that are under development. 
For example, the network now commonly known as the 
internet was originally a network of institutional net- 
works including university networks. As a result of the 



commercialization of the internet and the resultant 
reduction in quality of service, new generation internet 
type networks are under development to better achieve 
the purposes of the original "internet". Moreover, new 
5 international standards and protocols are being 
approved to create additional and enhanced internets. 
For the sake of simplicity, however, each of the world- 
wide internet networks will be referred to collectively as 
the internet. 

w [0006] Regarding its physical aspects, the internet 
is a packet switched network that is currently based 
upon a group of protocols known as transmission con- 
trol protocol/internet protocol (TCP/IP). TCP is a con- 
nection-oriented protocol that first establishes a 

15 connection between two computer systems that are to 
exchange data. TCP then breaks a given digital infor- 
mation signal into packets having a defined format The 
packets are then attached to headers that are for con- 
taining control and address information. 

20 [0007] For example, in addition to a destination 
address, a TCP packet typically contains a sequence 
number that is to be used by the destination in recon- 
structing a signal that is similar to. the original digital 
. information that was broken into packets at the originat- 

25 ing end. TCP packets also typically include port IDs, 
checksum values and other types of control information 
as is known by those skilled in the art. 
[0008] In order to make communication devices 
created by companies throughout the world compatible 

30 with each other to create local area networks and world- 
wide networks such as the internet, protocols, and 
standards are often defined. These protocols and 
standards are used to guide the design of the communi- 
cation devices, and more specifically, to guide the 

35 design of the operating logic and software within the 
devices. While communication devices that are 
designed in view of these standards do not always fol- 
low the suggested models exactly, they are usually com- 
patible with the protocol- defined interfaces (physical 

40 and logical). In order to appreciate the construction and 
operation of many devices, it is important to generally 
understand the concepts of some of the significant pro- 
tocol standards and models. 

[0009] One important model that currently guides 
45 development efforts is the International Standards 
Organization (ISO) Open Systems Interconnection 
(OSI) model. ISO/OSI provides a network framework or 
model that allows equipment from different vendors to 
communicate with each other. The OSI model organ- 
so izes the communication process into seven different cat- 
egories or layers and places these layers in a sequence 
based on their relation to the user, as is well known in 
the art 

[0010] With respect to the forgoing discussion 
55 regarding the seven OSI layers, IP is a layer three pro- 
tocol. In contrast, many of the backbone data transport 
infrastructures utilize a different layer protocol than an 
internet router. 
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[0011] Many of the common backbone data trans- 
port systems utilized include time division multiplexed 
(TDM) double ring transmission systems. Double ring 
TDM systems are generally known, especially for fiber- 
optic communication networks. In order to maintain 
transmission in the event of a fault on one of the chan- 
nels or communication links, it is typically common to 
find ring transmission systems in which transmissions 
occur in two directions, Specifically, transmissions occur 
in one direction through all of the nodes in the ring in a 
working path and through an opposite direction in a pro- 
tection path. The protection path is, traditionally, a 
redundant path for transmitting signals in a failure con- 
dition. Examples of fiber optic TDM systems include the 
SONET and SDH double ring fiber optic communication 
systems used in North America and Europe, respec- 
tively. 

[0012] In ordinary conditions, either the user traffic 
(data) in the redundant path in these double ring sys- 
tems is not routed through the protection path or, alter- 
natively,, it is routed but is not processed by a 
destination. At the same time, its communication chan- 
nels are reserved as an alternate path during failure 
conditions. The redundant path is typically used to route 
the data signals in an opposite direction from the work- 
ing path so that data that is to be routed to a destination 
node located, "downstream" from the failure condition 
may still be delivered to the destination node. 
[0013] One problem with this approach, however, is 
that the capacity of the redundant ring must be reserved 
as a redundant path. Transmission efficiency and 
throughput capacity must be sacrificed to provide data 
protection. Additionally, error conditions that prompt a 
node to switch to the protection path often are related to 
hardware (layer 1) problems in which communications 
are not being successfully transmitted in a communica- 
tion link. Switching does not occur for those conditions 
in which switching may be desirable even if there is not 
a hardware related error. For example, switching might 
be desirable to alleviate user traffic congestion. 
[0014] Additionally, several challenges exist in 
implementing dual ring topologies. For example, it is 
necessary for the switching from the working path to the 
protection path to occur quickly in the event of a fault so 
that a minimal amount of information is lost. Typically, 
switching occurs at the layer 1 level to minimize the 
down time. As a result, however, little error protection is 
provided at the hardware level for failures. Additionally, 
layer 1 switching results in the switching of entire data 
transport pipelines. By way of example, a typical pipe- 
line that is switched as a result of a layer 1 switching 
decision and event is either a 155 mega bits per second 
(Mbps), 622 Mbps or 2.4 giga bits per second (Gbps) 
pipeline. 

[001 5] To accomplish fast switching, layer 1 over- 
head signaling messages are generated and transmit- 
ted back to the ingress node (among other nodes) 
identifying the fault condition so that the protection 
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switching may occur.quickly. More specifically, layer 1 
overhead signaling messages are transmitted by the 
nodes detecting the error (typically the two nodes on 
either traffic side of the detected problem) on a commu- 

5 nication link so that the ingress node may effectuate the 
change on a quick basis. Typically, the ingress node 
includes dedicated circuitry for reading, interpreting and 
quickly responding to the overhead signaling message 
to effectuate a change. As is implied by the foregoing 

jo '"discussion, the overhead signaling is set upon the 
occurrence of a significant hardware failure in a commu- 
nication link. 

[0016] Historically, delays that are encountered in 
the internet have been acceptable, though not well 

is liked, in the context of computer to computer communi- 
cations. As other types of data are transported over the 
internet, by way of example, either voice or video, there 
will be a need for transporting data in large quantities in 
a quick manner. Due to this reason, failure recovery 

20 should be fast There is, therefore, an increasing need 
for. integrating internet communication networks with 
fiber optic ring networks utilizing a TDM protocol for 
transporting data because of the speed and throughput 
capacity of fiber optic ring networks. Accordingly, there 

25 is a need for a fiber optic ring network node that is capa- 
ble of reliably and quickly transporting user traffic to and 
from the internet. 

Summary of the Invention 

30 

[0017] To overcome the shortcomings of the prior 
systems and their operations, the present invention con- 
templates a fiber optic ring network node that includes a 
forwarding table that allows the node the capability of 

35 routing a data packet through a working path or through 
a protection path in a fiber optic ring network on a 
packet by packet basis. The node further includes cir- 
cuitry that prompts the node to generate an overhead 
signal on the fiber optic ring network to all other nodes 

40 connected to the ring to advise them of a failure condi- 
tion in a communication link that is adjacent to the node. 
The types of failure conditions that result in the over- 
head signal being generated by the node included typi- 
cal OS! layer 1 faults as well as layer 2 faults and layer 

45 3 conditions. Layer 3 conditions include traffic conges- 
tion and other similar conditions. Because each node on 
the fiber optic ring network includes the circuitry for gen- 
erating the overhead signal whenever a failure condition 
occurs in a communication link, two overhead signals 

so will typically be generated, one by each node adjacent 
to the failure condition location. 

[0018] Responsive to the receipt of at least one 
overhead signal identifying a communication link failure, 
a node serving as an ingress node for IP usertraffic per- 
55 forms packet level path restoration on a very fast basis. 
Subsequent data packets whose ordinary working path 
routes are affected by the communication link failure 
may be routed by its ingress node on a protection path 
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route to reach its destination node. . 
[0019] The inventive system is designed to provide 
very fast packet level path restoration. Because the 
overhead signal that advises all of the nodes on the 
fiber optic ring network is generated at the layer 2 level 
of the OSI model, the signal is generated very quickly 
after the communication link failure occurs. In a pre- 
ferred embodiment, the computer circuitry is optimized 
to generate the overhead signal within fifteen millisec- 
onds of the failure condition occurring. Similarly, the 
ingress nodes are formed to perform path restoration 
within thirty five milliseconds of receiving the overhead 
signal. In total, therefore, path restoration occurs within 
fifty milliseconds of a failure condition occurring. 
[0020]. The types of failures that prompt the node to 
generate the overhead signal advising of a failure 
include not only the layer 1 and layer 2 failures, but also 
the layer 3 types of network conditions. Accordingly, 
even a condition such as congestion in a communica- 
tion link may prompt nodes on the network to switch 
from the first to the second ring. As such, even layer 3 
conditions that have, in the past, gone undetected for as 
long as a minute or more, are detected and responded 
to by the inventive systems disclosed herein within fifty 
milliseconds. 

[0021] Because the invention contemplates packet 
level path restoration depending on factors such as des- 
tination and path conditions, there no longer exists' a 
need to reserve large amounts of bandwidth on the sec- 
ond fiber optic ring network to provide protection path 
capacity. Additionally, in one embodiment of the inven- 
tion, no reservations are made for protection path 
switching. Rather, each signal is assigned a quality of 
service (QoS) priority that is used to resolve interfer- 
ence conditions wherein signals are transmitted in order 
of priority. As a result, large gains in fiber optic ring net- 
work throughput capacity may be realized. 

Brief Description of the Drawings 

[0022] A better understanding of the present inven- 
tion can be obtained when the following detailed 
description of the preferred embodiment is considered 
with the following drawings, in which: 
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is a functional block diagram of a 
schematic of a network for trans- 
porting IP user traffic over a fiber 
optic ring; 

is a schematic diagram of a plu- 
rality of IP routers connected in a 
fiber optic ring for transporting IP 
user traffic over a fiber optic ring 
network; 

is a functional block diagram of a 
fiber optic ring network including 
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Figure 1 1 



a plurality of nodes for routing IP 
user traffic over a fiber optic ring 
network according to a preferred 
embodiment of the invention; 

is a functional schematic illus- 
trating the components of a cen- 
tral ingress node according to a 
preferred embodiment of the 
invention; 

is a functional schematic illus- 
trating the components of a fiber 
optic ring network node accord- 
ing to a preferred embodiment of 
the invention; 

is a functional block diagram 
illustrating packet level forward- 
ing in a fiber optic ring network 
using multi-packet label switch- 
ing and forwarding tables 
according to a preferred embod- 
iment of the invention; 

is a diagram illustrating the ele- 
ments of a user traffic data 
packet transmitted by a node on 
a fiber optic ring network accord- 
ing to a preferred embodiment of 
the invention; 

is a flow chart illustrating a 
method in a node for forwarding 
a packet of data on a TDM fiber 
optic ring network according to a 
preferred embodiment of the 
invention; 

is a flow chart illustrating a 
method in a node for detecting a 
communication link failure and 
for sending a signal to other 
nodes in the fiber optic ring net- 
work to inform them of the com- 
munication link failure; 

is a flow chart illustrating a 
method in a fiber optic ring net- 
work node for controlling for- 
warding/routing of the IP traffic 
through the fiber optic ring 
according to a preferred embod- 
iment of the invention; 

is a flow chart illustrating a 
method in a fiber optic ring net- 
work node for receiving IP user 
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traffic from an external source 
and for transmitting it over a fiber 
optic ring network according to a 
preferred embodiment of the 
invention; and 

Figures 12A and 12B are tables that illustrate a 
method for protection path 
resource allocation according to 
an embodiment of the invention. 

Detailed Description of the Drawings 

Description of a Needed Solution 

[0023] Modern networks are being designed to 
transport user traffic containing varying types of infor- 
mation including voice, image, text, control signals and 
numerical data. The user traffic is routed through 
access multiplexers, gateways (interface devices for 
systems communicating using differing formats), add 
drop multiplexers (ADMs), fiber optic cross connects, 
ATM switches and internet protocol (IP) routers. Multiple 
layers of routing, multiple logical layers of path estab- 
lishment, and different technologies guide the routing 
and paths used for transporting the user traffic. 
[0024] ' As mentioned before, the internet is a plural- 
ity of networks that are coupled by high capacity data 
transport mediums. One very important data transport 
medium is the fiber optic ring network such as SONET 
or SDH networks (collectively, "fiber optic ring net- 
works). Fiber optic ring networks typically utilize a proto- 
col that includes data packets having a fixed or defined 
length. For example, a SONET network "cell'* is a data 
packet that allocates 48 bytes for data and 5 bytes for a 
header. 

[0025] The fiber optic ring network is, today, a dual 
ring fiber optic network that transports optical signals in 
a working path and, at least occasionally, in a protection 
path using time division multiplexing. Because fiber 
optic ring networks will increasingly be used to transport 
IP user data as the importance of the internet continues 
to grow, the fiber optic ring networks and IP networks 
must be made to coexist in a compatible and acceptable 
manner. By some estimates, IP traffic will be the most 
common type of traffic transported over fiber optic ring 
networks in the next century. 

[0026] Accordingly, there is an increasing need for 
transporting IP over fiber optic ring networks. The inven- 
tors herein have observed that combining IP and TDM 
to meet this need, however, requires level 3 type func- 
tionality to be performed in addition to level 1 and level 
2 functionality on the fiber optic ring networks. This 
combination is necessary in order to have a system that 
is able to fully interact with IP Routers and that can 
dynamically make routing decisions on a fiber optic ring 
network as communication link problems are detected. 
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Potential Solutions ^ . 

[0027] Figure 1 is a functional block diagram of a 
schematic of a network for transporting IP user traffic 

5 over a fiber optic ring. Referring now to Figure 1 , central 
IP router 1 00 is connected to deliver and receive IP user 
traffic to and from ADM 104. ADM 104 is coupled to 
transmit and receive user traffic over fiber optic ring 108 
in a TDM format. Central IP router 100 is coupled to IP 

io . routers 112, 116 and 120 via control lines 114, 118 and 
122, respectively, in a star configuration to control the 
routing of the user traffic for which central IP router 100 
was the ingress node. Generally, each of the routers 
100, 112, 116 and 120 are similar in structure. IP router 

15 1 00 is a "central" I P router for all user traffic for which IP 
router 100 was the ingress point for the fiber optic ring 
network. 

[0028] As may be seen, central IP router 100 also is 
connected to the internet to receive internet user traffic 

20 as well as internet parameter data 1 24 as shown in Fig- 
ure 1. Internet parameter data includes information 
regarding networks and computer systems that are cou- 
pled to the internet as* well as path information (e.g., 
communication link failures). Centra! IP router 100 uses 

25 the internet parameter information to determine IP 
packet routing whenever it receives a packet of data that 
is to be transmitted to a specified location. 
[0029] In operation, central IP router 100 receives 
user traffic in IP packet form from, by way of example, 

30 the internet and determines where the packet should be 
routed. For those packets that it determines should be 
routed through the fiber optic ring network, central IP 
router 1 00 produces the user traffic to the fiber optic ring 
ADM without any knowledge of the fiber optic ring archi- 

35 tecture or its available paths. Central IP router 100 
merely specifies the destination IP router address and 
allows ADM 1 04 to route the IP packets to the ADM that 
is coupled to the specified IP router that is specified in 
the IP path routes. Stated differently, central IP router 

40 1 00 treats the ADM and the fiber optic ring merely as a 
transport layer. 

[0030] One less desirable effect of this configura- 
tion is that the IP router does not receive or evaluate 
information regarding topology (including layer 1 or 

45 layer 2 failure information) or restoration capability, for 
. the fiber optic ring. Stated differently, the layer 3 routing 
functionality of central IP router 100 does not include 
any analysis of layer 1 and layer 2 operations in the fiber 
optic ring. Thus, the layer 3 functionality of central IP 

so router 1 00 only detects a layer 1 failure condition in the 
fiber optic ring whenever user traffic fails to reach a des- 
tination. 

[0031 ] One advantage of the configuration of Figure 
1 is that it provides for fast switching times in the fiber 
55 optic ring in the event of a layer 1 or layer 2 failure within 
the ring. A disadvantage is cost because it requires a 
full IP router and an ADM at each node of the fiber optic 
ring in addition to a separate star or mesh network cou- 
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pling each IP router in the network to the central IP 
router 100. 

[0032] That the fiber optic ring performs switching 
within its network in response to a failure transparently 
with respect to the IP router suggests that throughput 
redundancy is required. In other words, the capacity of 
the working paths in a fiber optic ring network must be 
duplicated in a protection path to have a system that 
transparently switches user traffic paths whenever a 
communication link failure occurs. It is common, byway 
of example, to have channels of at least 155 Mbps 
capacity to be fully reserved on the protection path for 
corresponding channels on the workjng path. Thus, 
while the solution of FIG. 1 is advantageous in that pro- 
tection switching occurs quickly at the layer 1 and layer 
2 levels, it is not an economic solution in terms of trans- 
port efficiency. 

[0033] Figure 2 is a schematic diagram of a plurality 
of IP routers connected in a fiber optic ring for transport- 
ing IP user traffic over a fiber optic ring network. Refer- 
ring now to Figure 2, a central IP router 204 is coupled 
to IP routers 208, 212 and 216 via fiber optic ring 220. 
IP router 204 also is coupled to receiver user traffic and 
internet parameter data 124 from an external source 
.(e.g., the internet). 

[0034] In operation, central IP router 204 receives 
user traffic and routes it through the fiber ring network of 
IP routers according to IP addresses specified in the 
headers of the IP packets according to TCP/IP formats 
and protocols. One advantage of the network of Figure 
2 is that it is less expensive than the network of Figure 1 
because it does not require the AD Ms to route the IP 
user traffic yet it is capable of routing IP user traffic over 
a fiber optic ring network. A disadvantage observed by 
the inventors of this application, however, is that the IP 
routers 204 -216 of 

[0035] Figure 2 operate at layer 3 of the OSI model. 
Accordingly, in the event of a layer 1 or layer 2 type of 
communication link failure, it may take tens of seconds 
or even minutes to detect the failure by the layer 3 func- 
tionality of IP router 204. Typically, communication link 
failures are detected at layer 3 when the IP router trans- 
mitting an IP packet of user traffic does not receive an 
■ expected signal. It would be advantageous to have a 
system in which functionality of layers 1 through 3 are 
provided in a system capable of responding to failures 
and conditions detected at any layer within fifty millisec- 
onds. 

Description of the Preferred Solutions 

[0036] Figure 3 is a functional block diagram of a 
fiber optic ring network including a plurality of nodes for 
routing IP user traffic over a fiber optic ring network 
according to a preferred embodiment of the invention. 
Referring now to Figure 3, a node 300 includes a proc- 
essor 304. Processor 304 is coupled to communicate 
with a memory 308 for storing a routing table, a memory 
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312 for storing a forwarding table, and a storage device 
316 for storing computer instructions. The computer 
instructions are instructions that defined the functions 
that are to be performed by node 300 including creating 
5 the routing and forwarding tables stored in memories 
308 and 312, respectively. 

[0037] Processor 304 also is coupled to a pair of 
transceivers 324 and 328 (interface devices) for trans- 
ceiving communication signals on a first and a second 
10 ring of the fiber optic ring network. Traditionally, the first 
ring is the working path ring and the second ring com- 
prises a protection path ring wherein the amount of 
reserved capacity is equal to the working path capacity. 
As will be described in greater detail, however, the 
75 invention contemplates utilizing both rings for carrying 
. working path traffic. Unlike the traditional approach of 
reserving equal resources for working path as well as 
for protection path, the amount of resources reserved 
for working paths is greater than what is reserved for the 
20 protection paths in the described embodiments of the 
invention. 

[0038] Nodes 340, 344 and 348 each include a 
processor communicatively coupled with a memory for 
storing a forwarding table and a storage device for stor- 
25 ing computer instructions that defined operational logic 
and responses for the nodes. Additionally, each of the 
nodes 340, 344 and 348 include a pair of transceivers 
for transceiving communication signals on the first and 
second, rings. As may be seen, for the purposes of 
30 explaining the operation of the invention herein, the 
. nodes 340, 344 and 348 do not include a memory for 
storing a routing table. 

[0039] . In the described embodiments of the inven- 
tion, each of the nodes 300, 340, 344 and 348 include 
35 the elements and logic described herein. The different 
nodes may have different functionality. Additionally, 
while not explicitly shown herein, nodes 300, 340, 344 
. and 348 also include a transceiver port for receiving and 
transmitting IP user traffic from and to the internet and 
40 may act as an ingress or central node. Accordingly, the 
nodes can include memory for storing routing tables in 
an alternate embodiment The additional logic devices 
and transceivers are not explicitly shown herein for sim- 
plicity. 

45 [0040] In operation, the invention herein includes 
many different inventive processes and methods. In 
general, however, central node 300 receives IP user 
traffic from the internet and converts the IP user traffic to 
a format suitable for the fiber optic ring network of Fig- 
so ure 3. For example, in the described embodiment, a 
TDM format is used for conducting traffic through the 
ring network. 

[0041] More specifically, a central node 300 
receives the IP user traffic, converts it to a TDM format, 
55 and then decides how to properly route the traffic 
according to its routing and forwarding tables stored 
within its memory as will be described in greater specif- 
icity below. To transmit the TDM user traffic, node 300 
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inserts a label in the header of the TDM traffic in the 
described embodiment. The nodes within the network 
then utilize a multi-protocol label switching (MPLS) to 
forward the packet through the network. 
[0042] While different types of packets and forward- 
ing schemes may be used, the described embodiment 
includes using an MPLS scheme in which each node 
examines a label value in a received packet, determines 
a corresponding label value that implicitly defines sev- 
eral parameters including the next path and communi- 
cation link, and then transmits the packet with the 
corresponding label value. 

[0O43] Additionally, the inventive nodes include 
logic within the storage devices that prompt the 
processing unit to generate an overhead signal. The 
overhead signal is transmitted by at least one node that 
detects the communication link condition or failure in an 
adjacent communication link to all other nodes in the 
fiber optic ring network including the central or ingress 
node 300. Node 300, responsive to receiving the over- 
head signal responds by assigning labels having label 
values that cause ail subsequent packets whose work- 
ing path includes going through the failed communica- 
tion link to be transmitted by way of a protection path to 
avoid the communication link failure. 
[0044] If, by way of example, a link failure occurs in 
the portion of the working paths of ring 332 in between 
nodes 344 and 348, then ail packets that are to be trans- 
mitted from node 300 to node 340, 344 and finally to 
.. node 348, are transmitted through a protection path 
along ring 336 directly from node 300 to node 348. This 
examples assumes that the working path traffic flows 
from node 300 to node 348 through nodes 340 and 344. 
[0045] Figure 4 is a functional schematic illustrating 
the components of a central ingress node according to 
a preferred embodiment of the invention. Referring now 
to Figure 4, an ingress node 400, for the purposes 
herein, is a node that receives IP traffic that requires 
routing through the fiber optic ring network. In the pre- 
ferred embodiment of the invention, the ingress node 
400 is responsible for determining the path route for a 
data packet through the fiber optic ring network. 
[0046] Central ingress node 400 includes a proces- 
sor 402 that is communicatively coupled to a memory 
404, a storage device 406 and a peripheral bus inter- 
face through a bus 41 0. Peripheral bus interface, in turn, 
is communicatively coupled with network interface 
devices 41 2A, 41 2B, 41 2C, 41 2D and 41 2E. Each of 
these network interface devices are connected, for 
exemplary purposes, to an IP router, an IP node, a first 
ring of a fiber optic ring network, a second ring of a fiber 
optic ring network, and a communication control line, 
respectively. 

[0047] Storage device 406 can be formed of any 
one or of a plurality of devices for storing operational 
logic, protocol information, programming steps and 
instructions, and gateway logic to convert signals from 
one protocol to another. By way of example, portion 
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406A is for storing instructions for creating forwarding 
and routing tables. Portion 406B is for storing opera- 
tional logic for determining whether user traffic, on a 
- packet by packet basis should be transmitted or for- 

5 warded through the fiber optic ring network through a 
working path or a protection path. Portion 406C is for 
storing programming and process steps for generating 
an overhead signal to alt nodes on the fiber optic ring 
network to inform them of a detected communication 

ro . link failure in an adjacent node. 

[0048] In terms of hardware, storage device 406 
comprises, in the described embodiment, an electro- 
magnetic disk drive that has read/write capability. In 
additional embodiments, storage device 406 comprises 

rs read only memory (ROM) circuits, compact disk (CD) 
ROM devices, Read/Write CDs, tape drives, floppy 
disks (and similar devices), and other known informa- 
tion storage mediums. 

[0049] Storage device 406 of node 400 includes 

20 computer instructions that define logic for indicating and 
causing processor 402 to produce a signal on the fiber 
optic ring network indicating that a failure condition has 
occurred in an adjacent communication link on the fiber 
optic ring. There are many different indicators of failed 

25 communication links including the mere lack of receipt 
of expected communication signals. In the described 
embodiment, the information in storage device 406 
causes processor 402 to generate an overhead signal 
that is used to inform other nodes on the fiber optic ring 

30 network of a detected failure. By way of example, if the 
fiber optic ring network is a SONET ring, processor 402 
generates a k1/k2 overhead signal. 
[0050] Those skilled in the art readily can appreci- 
ate the specific conditions that could cause a node to 

35 determine a communication link failure has occurred in 
an adjacent communication link. The computer instruc- 
tions stored within storage device 406 also define logic 
for determining that traffic conditions on adjacent com- 
munication links require alternate routing/forwarding. By 

40 way of example, a specified amount of traffic congestion 
may be defined to require protection path switching. In 
the preferred embodiment of the invention, the compu- 
ter instructions are selected to cause processor 402 to 
select between the working and protection paths 

45 according to traffic conditions on a packet by packet 
basis. 

[0051] The computer instructions within storage 
device 406 also include instructions for creating routing 
and forwarding tables. To illustrate, as is known by those 

so skilled in the art, an IP router includes logic for creating 
IP packet routing tables based upon network conditions. 
The phrase "network conditions" includes an awareness 
of the electrical presence of internet nodes and routers. 
The programming instructions within the central ingress 

55 node 400 include similar logic defined by its computer 
instructions. Additionally, however, the computer 
instructions in the storage device 406 also include pro- 
gramming steps to define the packet routing/forwarding 



7 



13 EP 1 o: 

through the fiber optic ring network. 
[0052] In addition, the computer instructions within 
storage device 406 define logic for creating an MPLS 
forwarding table having entries that define path routes 
by way of the selected labels that are consistent with the 
defined routes of the routing table. Additionally, how- 
ever, the labels define path routes for working as well as 
protection paths through the fiber optic ring network. 
[0053] Memory 404 comprises random access 
memory (RAM) with read/write capability for storing 
operational information while node 400 is operational 
and is receiving power. By way of example, memory 
portions 404A and 404B are for storing the routing and 
forwarding tables, respectively, created by processor 
402 while executing the programming instructions 
stored in memory portion 406A of storage device 406. 
Memory portion 406C is for storing information relating 
to network conditions. By way of example, if node 400 
either determines on its own or is informed of a network 
communication link failure, information defining the type 
of failure and its location are stored in memory portion 
406C of memory 406. 

[0054] Additionally, information stored within stor- 
age device 406C defining the fiber optic network ring 
node such as the nodes that are electrically present, 
and the communication paths are stored in memory 
portion 404C for use by processor 402. Additionally, 
memory 404 includes data used by processor 402 while 
executing program steps or computer instructions 
defined in portions 406A, 406B and 406C of storage 
device 406 as well as in other portions of the storage 
device. Memory 404 also is for, among other things, 
storing a fiber optic ring failure condition that was deter- 
mined by node 300 or that was indicated in a received 
overhead signal. In terms of hardware characteristics of 
memory 404, different types of memory may be used. 
By way of example, memory 404 can comprise 32 bit 
flash program storage, dynamic RAM, static RAM, etc. 
Processor 402 is a standard processing unit formed 
within similar computerized devices and is capable of 
controlling operations of the node 400 according to the 
operational logic defined within storage 406. Proces- 
sors that may be used include customized ASIC 
devices, off the shelf processors including common 
commercially available microprocessors and other simi- 
lar devices. 

[0055] Peripheral bus interface 408 is a standard 
bus interface that allows processor 402 to communicate 
with and control the communications that occur over a 
plurality of network interface devices 412 that are cou- 
pled to peripheral bus interface 408. Network interface 
devices 41 2 are transceivers of various types that are 
coupled to communicate with specific devices. While 
the described embodiment includes a peripheral bus 
interface 408, other known devices may be substituted 
according to system implementation. By way of exam- 
ple, a cross connect switch or a demultiplexer may be 
used in place of peripheral bus interface 408. 
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[0056] The network interface devices of Figure 4 
may be formed of different known interface systems. For 
example, they may comprise radio modems, digital sig- 
nal processors, ASICs, T1/E1 interface devices, etc. 

5 The type of device utilized as a network interface device 
412 is a function of the type of device with which it will 
be expected to communicate and can include transceiv- 
ers of all known types. 
' [0057] In operation, processor 402 of node 400, in 

w the described embodiment, is operable, in conjunction 
with computer instructions in storage device 406, to 
detect and respond to the a communication link failure 
or traffic condition (e.g., congestion). Within the 15 milli- 
seconds, processor 402 generates the overhead signal 

15 indicating a communication link failure or traffic condi- 
tion within fifteen milliseconds of the communication link 
failure or condition being detected (collectively "commu- 
nication link failure"). . 

[0058] Similarly, in the described embodiment, 

20 processor 402 is operable, in conjunction with computer 
instructions in storage device 406, to detect and 
respond within a 35 millisecond period to a received 
overhead signal used to indicate a failure condition in a 
communication link within the fiber optic ring network. 

25 Stated differently, the programming instructions within 
storage device 406 are written to cause processor 402 
to initiate protection path routing/forwarding within 35 
milliseconds of receiving the overhead signal. 
[0059] Any known scheme for causing a processing 

30 unit to respond promptly including an interrupt scheme 
may be used. By way of example, processor firmware 
may be used to generate a flag or interrupt to cause the 
processor to execute a specified routine to initiate pro- 
tection path forwarding/switching. 

35 [0060] Figure 5 is a functional schematic illustrating 
the components of a fiber optic ring network node 
according to a preferred embodiment of the invention. In 
general, node 500 is for receiving and forwarding data 
packets on a fiber optic ring network. Node 500 includes 

40 a processor 502 that is communicatively coupled to a 
memory 504, a storage device 506 and a peripheral bus 
interface through a bus 510. Peripheral bus interface, in 
turn, is communicatively coupled with network interface 
devices 512A, 512B, 512C, 512D and 512E. Each of 

45 these network interface devices are connected, for 
exemplary purposes, to an IP router, an IP node, a first 
ring of a fiber optic ring network, a second ring of a fiber 
optic ring network, and a communication control line, 
respectively. 

so [0061] Storage device 506 can be formed of any 
one or of a plurality of devices for storing operational 
logic, protocol information, programming steps and 
instructions for specified functions. By way of example, 
portion 506A is for storing instructions for creating and 

55 generating error signals regarding communication link 
failures whenever specified conditions are detected in 
an adjacent ring. Portion 506B is for storing operational 
logic for forwarding received packets, on a packet by 
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packet basis through the fiber optic ring network either 
through a working path or a protection path. Portion 
506C is for storing ring topology information for using in 
determining how to forward a received data packet. 
[0062] In terms of hardware, storage device 506 
comprises, in the described embodiment, an electro- 
magnetic disk drive that has read/write capability. In 
additional embodiments, storage device 506 comprises 
read only memory (ROM) circuits, compact disk (CD) 
ROM devices, Read/Write CDs, tape drives, floppy 
disks (and similar devices), and other known informa- 
tion storage mediums. 

[0063] * With respect to the programming instruc- 
tions stored in portion 506A of storage device 506 of 
node 500, storage device 506 includes computer 
instructions that define logic for indicating and causing 
processor 502 to produce a signal on the fiber optic ring 
network. This signal is for indicating that a failure condi- 
tion has occurred in an adjacent communication link on 
the fiber optic ring. There are many different indicators 
of failed communication links including the mere lack of 
receipt of expected communication signals. 
[0064] In the described embodiment, the informa- 
tion in storage device 506 causes processor 502 to gen- 
erate an overhead signal that is used to inform all other 
nodes on the fiber optic ring network of a detected fail- 
ure. Byway of example, if the fiber optic ring network is 
a SONET ring, processor 502 generates a k1/k2 over- 
head signal that is transmitted to all nodes on the fiber 
optic ring network. 

[0065] Those skilled in the art readily can appreci- 
ate the specific conditions that could cause a node to 
determine a communication link failure has occurred in 
an adjacent communication link. The computer instruc- 
tions stored within storage device 506 also define logic 
for determining that traffic conditions on adjacent com- 
munication links require alternate routing/forwarding. By 
way of example, a specified amount of traffic congestion 
may be defined to require protection path switching. 
[0066] The computer instructions within storage 
device 506 also include instructions for determining how 
to forward a' received packet. The computer instructions 
within storage device 506B define logic for forwarding 
data packets according to an MPLS forwarding table 
stored in memory. As will be described in greater detail 
below, the computer instructions in portion 506B prompt 
processor 502 to switch label values for a received 
packet and to forward the packet according to the newly 
inserted label value. The MPLS labels define path 
routes for working as well as protection paths through 
the fiber optic ring network. 

[0067] The computer instructions within portion 
506A of storage device 506 include defined. topology 
information for the fiber optic ring network. By way of 
example, information regarding each of the nodes 500 
in the ring as well as their node IDs and, in some 
embodiments, their port IDs. The use of the port IDs 
and node IDs will be described in greater detail below. 
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[0068] Memory . 504 comprises random access 
memory (RAM) with read/write capability for storing 
operational information while node 500 is operational 
and is receiving power. Memory portions 504A and 

5 504B are for storing information regarding network con- 
ditions and forwarding tables, respectively. By way of 
example, if node 500 either determines on its own or is 
informed of a network communication link failure, infor- 
mation defining the type of failure and its location are 

to •" stored in memory portion 506A of memory 506. The for- 
warding table in memory portion 504B is stored in an 
MPLS format Other formats for the forwarding informa- 
tion may also be used for the forwarding to packets 
through the fiber optic ring network. 

is [0069] In terms of hardware characteristics of mem- 
ory 504, different types of memory may be used. By way 
of example, memory 504 can comprise 32 bit flash pro- 
gram storage, dynamic RAM, static RAM, etc. Proces- 
sor 502 is a standard processing unit formed within 

20 similar computerized devices and is capable of control- 
ling operations of the node 500 according to the opera- 
tional logic defined within storage 406. Processors that 
may be used include customized ASIC devices, off the 
shelf processors including common commercially avail- 

25 able microprocessors and other similar devices. 

[0070] Continuing to refer to Figure 5, processor 
502 also is coupled to transmit and receive user traffic 
on the fiber optic ring network through a plurality of net- 
work interface devices 512A through 51 2E by way of a 

30 peripheral bus interface device 508 and a bus 510. 
While the described embodiment includes a peripheral 
bus interface 508, other known devices may be substi- 
tuted according to system implementation. By way of 
example, a cross connect switch or a demultiplexer may 

35 be used in place of peripheral bus interface 508. 

[0071] The network interface devices of Figure 5 
may be formed of different known interface systems. For 
example, they may comprise radio modems, digital sig- 
nal processors, ASICs, T1/E1 interface devices, etc. 

40 The type of device utilized as a network interface device 
512 is a function of the type of device with which it will 
be expected to communicate and can include transceiv- 
ers of all known types. 

[0072] In operation, processor 502 of node 500, in 
45 the described embodiment, is operable, in conjunction 
with computer instructions in storage device 506, to 
detect and respond to the a communication link failure 
or traffic condition (e.g., congestion). Within the 15 milli- 
seconds, processor 502 generates the overhead signal 
so indicating a communication link failure or traffic condi- 
tion within fifteen milliseconds of the communication link 
failure or condition being detected (collectively "commu- 
nication link failure"). 

[0073] Figure 6 is a functional block diagram illus- 
55 trating packet level forwarding in a fiber optic ring net- 
work using multi-packet label switching and forwarding 
tables according to a preferred embodiment of the 
invention. A fiber optic ring network central node 600 is 
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coupled to receive IP data packets 6 t 04 from the inter- 
net. In addition to node 600, the fiber optic network ring 
includes nodes 616, 620 and 624. . Node 600 includes a 
memory 608 for storing routing/forwarding information. 
Node 616 includes a memory for storing a forwarding 
table that has an entry that maps label A2 to label B7. 
Node 620 includes a memory for storing a forwarding 
table that has an entry that maps label B7 to label C3. 
[0074] In operation, node 600 must change the for- 
mat of the received IP packet 604 to a TDM format. In 
the process of forming a. TDM packet, node 600, the 
preferred embodiment, adds a label to create data 
packet 612. The label implicitly defines a path route for 
the next communication link. For the example herein, 
node 600 adds label A2 to the data packet 604. As may 
be seen, memory 608 includes a defined path route 
through the fiber optic ring network. For any packet 
given the label A2, that packet will be transmitted in a 
channel or path assigned labels A2, B7 and C3. For the 
example herein, data packet 604 has a destination node 
within the fiber optic ring network of node 624 prior to be 
exported to another network such as the internet 
[0075] Node 500 transmits data packet 612 over a 
channel that corresponds to label A2. When data packet 
612 reaches node 616, its label A2 is replaced with label 
B7 by node 616 and then is transmitted over the chan- 
nel that corresponds with label B7 as data packet 618. 
Similarly, node 620 replaces the label B7 with label C3. 
The data packet is then transmitted as data packet 622 
over the channel that corresponds with label C3. 
[0076] In the example herein, each of the nodes 
616, 620 and 624 examine additional information within 
a header of the received data packets to determine 
whether it is the final destination on the fiber optic ring 
network for the packet In the example of Figure 6, the 
final node of the fiber optic ring network to receive the 
data packet is node 624. Node 624, upon receiving the 
data packet, examines a port ID within the header to 
determine that the specified port ID Is a port of node 
624. 

[0077] Other designs may also be used to accom- 
plish the same result Rather than having the nodes 
examine port IDs in the header of the received data 
packets, the forwarding tables may be used to achieve, 
the same result. By way of example, the memory of 
node 624 that contains the forwarding tables may be 
formed to include an entry to correspond to label C3 
(the label that is inserted into the packet by node 620) 
that defines a specified port connected to an external 
device. Such an entry, therefore, would cause node 624 
to realize that the packet is to be output through a spec- 
ified port to a device that is external to the fiber optic 
ring network. 

[0078]. In either embodiment, node 624 extracts the 
destination IP address from the header of the packet, 
converts the packet back to an IP format (along with 
other packets if necessary) and routes the packet back 
on to the internet to reach its destination. Those skilled 
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in the art readily know how to convert back and forth 
between TDM and IP formats. 

[0079] Figure 7 is a diagram illustrating the ele- 
ments of a user traffic data packet transmitted by a node 

5 on a fiber optic ring network according to a preferred 
embodiment of the invention. Referring now to Figure 7, 
an IP packet that is received by a central node 500 is 
converted to at least one TDM data packet such as data 
packet 700 shown in Figure 7. The data of the IP data 

io packet is inserted within portion 704. Some TDM pack- 
ets for common fiber optic ring networks are fixed length 
packets. Accordingly, a plurality of packets may be 
required if the data portion of the IP packet exceeds the 
capacity of the fixed length packet For example, in ATM 

75 based fiber optic ring networks, a fixed length packet 
known as a cell has 48 bytes for carrying user traffic 
data. Accordingly, an IP packet having more than 48 
bytes of data will require a plurality of cells to transport 
the data from the IP data packet through the fiber optic 

20. ring network. 

[0080] While IP user traffic data is placed within 
portion 404 of at least one data packet 400, the IP des- 
tination address is placed within portion 408 and the IP 
source address is placed within portion 412. As is also 

25 shown in Figure 7, the TDM packet label (MPLS label) is 
placed in portion 716. 

[0081] Because the preferred embodiment of the 
invention utilizes an MPLS scheme for transporting data 
packets, the label of portion 716 implicitly represents or 

30 defines a plurality of different sets of information. By 
way of example, the label represents the path route that 
is to transport the data packet for the next communica-. 
tion link. In addition to the path route, the label in the 
described embodiment also represents a quality of 

35 service (QoS) parameter that is associated with the 
data packet. As is understood by those skilled in the art, 
QoS provisioning usually specifies the priority that a 
given user receives forthe usertraffic especially in inter- 
ference situations, interference situations include those 

40 situations where, at a given moment, the demand for 
channeling resources exceeds throughput capacity. 
[0082] Different throughput rates (or levels of prior- 
ity in a QoS system) typically have different cost struc- 
tures. Accordingly, in the case of traffic congestion, QoS 

45 priority schemes are used to determine what signals are 
transmitted or are transmitted first. Finally, in the pre- 
ferred embodiment, a priority indication for reasons 
otherthan QoS are specified. For example, communica- 
tions by public officials regarding important public 

so events may be given a high priority. 

[0083] Finally, the label value inserted into portion 
716 also implicitly reflects the bandwidth of the channel 
being used to transmit the data packet As may be seen 
by examining Figure 7, if a signal is given a high priority 

55 (e.g., a signal being transmitted by a government 
agency in an emergency situation), that high priority can 
also be implicitly determined by the label assignment. 
Typically, it may be difficult to distinguish between a 
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label for a signal being given high priority and a label for 
a signal having a high QoS rating. As a general obser- 
vation, however, a priority signal would receive at least 
as much priority as a highest QoS rating. Accordingly, it 
is only in the situation wherein a signal receives an opti- 
mal label assignment that some ambiguity may exist as 
to whether it is a priority signal or a signal with a high 
QoS. In one embodiment, high priority signals merely 
receive the highest QoS rating available to expedite 
their transmission through the fiber optic ring network. 
[0084] Figure 8 is a flow chart illustrating a method 
in a node for forwarding a packet of data on a TDM fiber 
optic ring network according to a preferred embodiment 
of the invention. Referring now to Figure 8, a node, by 
way of example, node 616 of Figure 6 receives a data 
packet similar to packet 612 of Figure 6 (step 502). The 
node then examines the label of the received packet to 
determine how to process the packet (step 504). By way 
of example, the processor of the node communicates 
with, its internal storage device that contains program- 
ming instructions. The processor executes the program- 
ming instructions to extract the label in the received 
packet and to store it in memory for futher analysis. 
Thereafter, the node 340 determines whether the 
packet is to be reconstructed into an IP packet and then 
output from an output port of the node (step 806). More 
specifically, the processor (according to stored compu- 
ter instructions), in the preferred embodiment, examines 
a specified port identifier that identifies an egress port 
from the fiber optic ring network to an external device 
(e.g., to an IP router or IP node external to the fiber optic 
ring network). If the port identifier is one of the node 
processing the data packet, then the node examines a 
forwarding table as a part of processing and forwarding 
the packet 

[0085] In an alternate embodiment, rather than 
examine a port identifier, the node merely examines the 
received label. Then, from examining the contents of the 
forwarding table it knows whether to forward the packet 
with a new label value or whether to output the packet 
through an egress port. More specifically, if the forward- 
ing table includes an egress port identifier instead of a 
replacement label, then the node knows to reconstruct 
the packet into an IP format and to output it through the 
egress port identified in the forwarding table. 
[0086] Thereafter, assuming that node is not the 
final destination node on the fiber optic ring network, it 
determines the corresponding replacement label for the 
label that was received with the packet (step 808). 
Thereafter, the processor replaces the received label 
with the corresponding label value that it determined 
(step 810). The node then forwards packet according 
the new label value (step 812). 

[0087] Figure 9 is a flow chart illustrating a method 
in a node, by way of example nodes 300, 340, 344 or 
348 or nodes 400 and 500 of Figures 4 and 5, respec- 
tively, for detecting a communication link failure and for 
sending a signal to other nodes in the fiber optic ring 



network to inform them of the communication link fail- 
ure. Referring now to Figure 9, a node, by way of exam- 
ple, node 344, examines the adjacent communication 
links to verify that they are operating properly (step 

5 902). In the preferred embodiment, the examination of 
the adjacent communication links occurs on a periodic 
basis at a frequency that exceeds approximately 60 
times per second. Node 344 examines the adjacent 
communication links for layer 1, layer 2 and layer 3 

ro types of failures. Additionally, the term "failure", as used 
herein, includes layer 1 and Tayer 2 failures as well as 
layer 3 detected conditions including, by way of exam- 
ple, congestion and is not limited merely to severe fail- 
ures in which signals are not being successfully 

rs transmitted through the communication link. 

[0088] The computer instructions that enable a 
processor within a node to determine that a failure at 
any of the three OS I layers has occurred are stored 
within the storage device of the node. In the preferred 

20 embodiment, computer instructions include program- 
ming steps to detect error conditions in a variety of 
ways. More specifically, the computer instructions 
include programming steps to prompt the node test the 
communication link, to verify that no fault or error condi- 

25 tions are being indicated through routine error checking 
approaches, and to monitor transmission delays and 
whether specified signals are being received on a timely 
basis. For example, the failure of a successful commu- 
nication over a link as determined either by uncom- 

30 pleted handshaking between nodes or by the failure of 
node 348 to receive an expected signal within a speci- 
fied period indicates a communication link failure in an 
adjacent communication link. 

[0089] After examining the adjacent communication 

35 link conditions, node 348 determines whether any 
detected conditions or failures are of a type that require 
an ingress node, e.g., node 300 of Figure 3, to provide 
path restoration (step 904). Path restoration is the 
switching of communication link path routes from a 
, 40 working path to a protection path for at least some of the 
affected user data packets. If there is not a problem or 
condition that requires path restoration, the method 
illustrated in Figure 9 is complete until its next use. 
[0090] if a communication link failure does requires 

45 path restoration, i.e., the forwarding of some packets 
over the protection path, our exemplary node 344 gen- 
erates an overhead signal on all rings (if more than one) 
to inform all other nodes on the fiber optic ring network 
of the communication link failure and its location (step 

so 906). By way of example, in a SONET ring network, 
k1/k2 overhead bytes are used to reflect a problem in a 
communication link and its location. By transmitting the 
overhead signal to all of the nodes on the fiber optic ring 
network, each node that serves as an ingress node for 

55 TCP/IP data packets is made aware of the traffic condi- 
tion. This allows each ingress node to modify its rout- 
ing/forwarding tables, if necessary. Additionally, it allows 
the ingress nodes to assign labels that will cause data 
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packets to be forwarded through the protection path if its 
working path is affected by the failure. 
[0091] With reference again to the previous discus- 
sion and the use of protection paths to respond to fail- 
ures in a communication link, the overhead signaling 
that occurs to advise an ingress node of a communica- 
tion link failure occurs at layer 1 even though the condi- 
tion may be a layer 2 or a layer 3 condition. Given that 
each node includes logic to perform the method of Fig- 
ure 9, each of the two nodes that are adjacent to the 
communication link failure will generate the overhead 
signal identifying the failure condition. 
[0092] Moreover, the programming instructions are, 
in the described embodiment, created to perform the 
testing and error detection analyses at frequency rate 
that enables a communication link failure to be detected 
and responded to within a period of fifteen milliseconds. 
[0093] Figure 1 0 is a flow chart illustrating a method 
in a fiber optic ring network node for controlling forward- 
ing/routing of the IP traffic through the fiber optic ring 
according to a preferred embodiment of the invention. 
Referring now to Figure 10, an ingress node for IP traf- 
fic, for example, node 300, receives an overhead signal 
that contains an indication that a communication link in 
the fiber optic ring network has failed (step 1002). As 
before, "failed" includes OSI level 3 determinations and 
the location of the failure. The signal containing the indi- 
cation may be received from any node on the fiber optic 
ring network, by way of example, from nodes 340, 344 
or 348. 

[0094] After receiving the signal indicating that a 
communication link failure or condition has occurred, 
node 300 identifies the packets that it has received as IP 
packets and converted to TDM packets that pass 
through the failed communication link in their defined 
working paths (step 1004). 

[0095] For at least some types of failures, the 
ingress node updates its forwarding/routing tables to 
modify the defined working and protection paths for the 
data packets it generates onto the fiber optic ring net- 
work (step 1006). 

[0096] After the identifying step 1004, the ingress 
node determines appropriate protection path label val- 
ues for the affected data packets and sets the labels into 
the header of the outgoing data packets (step 1 008). 
Finally, the affected data packets are generated onto the 
fiber optic ring network and are forwarded along the pro- 
tection paths according to the newly set label values. 
[0097] Because it is an object of the present inven- 
tion to provide fast path restoration or switching, the 
computer instructions in the ingress node are formed to 
cause the ingress node to perform the protection path 
switching within 35 milliseconds of receiving the over- 
head signal in step 1002. Because the computer 
instructions in the nodes are formed to generate the 
overhead signal reflecting an error condition within fif- 
teen milliseconds and the ingress nodes include com- 
puter instructions formed to respond to the received 



overhead signal within thirty five milliseconds, the entire 
network is created to respond and provide path restora- 
tion in a period of fifty milliseconds from a communica- 
tion link failure. 

5 [0098] Alternatively, if the ingress node that deter- 
mines that a failure condition that has occurred in an 
adjacent communication link, it will respond and provide 
. path restoration within thirty five milliseconds of detect- 
- ing the failure condition in addition to generating an 
10 overhead signal to all other nodes, within fifteen millisec- 
onds. 

[0099] Figure 1 1 is a flow chart illustrating a method 
irv a fiber optic ring network node for receiving IP user 
traffic from an external source and for transmitting it 

75 over a fiber optic ring network according to a preferred 
embodiment of the invention. Referring now to Figure 
11, a node, by way of example, node 340 of Figure 3, 
receives an IP and converts it to a TDM protocol for 
transmission on the fiber optic ring network (step 1 102). 

20 If the fiber optic ring network is a SONET ring utilizing 
an ATM protocol, and, for example, if the actual data of 
the IP packet exceeds 48 bytes, then a plurality of TDM 
packets are used to transport the IP packet over the 
TDM based fiber optic ring network. 

25 [0100] If the IP data packet included a QoS param- 
eter, the label value assigned to the packet will reflect a 
QoS rating or rank. Alternatively, if an IP data packet 
does not have a QoS value stored within it, node 300 
assigns label values reflecting a QoS rank or rating 

30 according to either the source or final destination of the 
IP data packet or to the signal type. As a part of deter- 
mining an appropriate label value reflecting a QoS rat- 
ing, the node also compares the QoS rating to the rating 
of ail other packets that are to be transmitted. Accord- 

35 ingly, in an interference situation (wherein the instanta- 
neous demand exceeds capacity), the packets having 
higher QoS ratings will receive labels having label val- 
ues that gives those packets relative priority through the 
plurality of paths within a fiber optic ring network. In 

40 - other words, the QoS rating is evaluated to ring condi- 
tions on the first and second rings as a part of assigning 
a label having a specified label value (step 1 1 04). 
[0101] Additionally, as a part of assigning a label 
value, the node determines whether the data packet is 

45 to be transmitted on the first or second ring and what the 
corresponding path should be based upon its QoS rat- 
ing and upon the ring conditions in each ring (step 
1106). After evaluating the QoS rating, ring conditions 
and the relative QoS ratings of all of the packets waiting 

so to be transmitted onto the fiber optic ring network, a cor- 
responding label is inserted into the header of the 
packet and the packet is forwarded on the correspond- 
ing path(step 1108). 

[0102] Figures 12A and 12B are tables that illus- 
55 trate a method for protection path resource allocation 
according to an embodiment of the invention. Referring 
now to .Figures 12A, a traditional resource allocation 
scheme includes reserving equal amounts of resources 
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for protection paths and amounts of resources for work- 
ing paths. Stated a differently, a one to one relationship 
exists between working path and protection path 
resources. Thus, as may be seen, each channel identi- 
fied in the left hand column of the table in Figure 12Afor 5 
the working paths includes a unique channel assigned 
to it for protection path forwarding. 
[0103] Referring now to Figure 12B, however, a dif- 
ferent resource allocation scheme is disclosed. The * 
table of Figure 12B illustrates a four to one resource 10' 
allocation scheme. As may be seen, only one protection 
path B is reserved for restoration or protection path for- 
warding for the four paths A, C, E and G. For the exam- 
ple of Figure 12A, each of the reserved protection path 
channels is equal is throughput capacity to its corre- 15 
sponding working path channel. In the example of Fig- 2. 
ure 12B, however, there is no such correlation because 
there is an "N" to one ratio instead of a one to one ratio 
between the working and protection path throughput 
capacities. 20 
[0104] For each embodiment employing an N to 3. 
one ratio between the working paths and the protection 
paths, interference situations are resolved through a 
QoS priority scheme on a packet by packet basis in rela- 4. 
tion to ring conditions including traffic conditions. In one 25 
embodiment, no channels are reserved for protection 
path switching. Rather, QoS is used solely to determine 
traffic priority. As may be seen, for each of the described 5. 
embodiments, working path channels are defined on 
both rings in a two ring system. In a one ring system, 30 
working path traffic channels are defined for transmis- 
sions in both directions through the fiber optic ring 6. 
(clockwise and counter-clockwise). 
[0105] Each of the above methods are explained 
' and shown separately. Each of the methods, however, 35 
may readily be combined with other and all of the 
described methods as described or in a modified for- 
mat. Conversely, not all of the described methods nec- 
. essarity need to be included in practicing the described 
invention. While the invention is susceptible to various 40 
modifications and alternative forms, specific embodi- 
ments thereof have been shown by way of example in 
the drawings and detailed description. It should be 
understood, however, that the drawings and detailed 
description thereto are not intended to limit the invention 45 
to the particular form disclosed, but on the contrary, the 
invention is to cover all modifications, equivalents and 
alternatives falling within the spirit and scope of the 7. 
present invention as defined by the claims. For exam- 
ple, the described embodiments include two ring sys- so 
terns. One ring systems capable of conducting user 
traffic in both directions may readily be substituted for a 
two ring system. 

8. 

Claims 55 

1 . A fiber optic ring network node connected to a fiber 
optic ring, comprising: 
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a processor; 

an interface device coupled to the processor 
and to the fiber optic ring network; and 

a storage device for storing computer instruc- 
tions coupled to the processor, the computer 
instructions for prompting the processorto gen- 
erate an overhead signal onto the fiber optic 
ring by way of the interface device whenever a 
failure condition occurs in an adjacent commu- 
nication link within the fiber optic ring network 
wherein the failure is one that occurs at any 
one of a plurality of OS I protocol layers. 

The node of claim 1 wherein the computer instruc- 
tions are formed to detect and cause the processor 
to generate the overhead signal within fifteen milli- 
seconds of the occurrence of the failure condition. 

The node of claim 1 wherein the failure condition 
includes an OSl layer 2 communication link failure. 

The node of claim 1 wherein the failure condition 
includes an OSl layer 3 communication link condi- 
tion. 

The node of claim 4 wherein the communication t 
link condition includes traffic congestion exceeding 
a specified threshold. 

A fiber optic ring network node connected to a fiber 
optic ring, comprising: 

a processor; 

an interface device coupled to the processor 
and to the fiber optic ring network; and 

a storage device for storing computer instruc- 
tions coupled to the processor, the computer 
instructions for prompting the processor to pro- 
vide path restoration for data packets affected 
by a communication link failure on a packet by 
packet basis within a specified period when- 
ever a communication link failure occurs. 

The node of claim 6 wherein the computer instruc- 
tions determine a communication link failure has 
occurred by evaluating an overhead signal that was 
received from another node on the fiber optic ring 
network. 

The node of claim 6 wherein the node provides path 
restoration within a period that is no more than 
approximately thirty five milliseconds after receiving 
the k1/k2 overhead signal. 
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9. The node of claim 6 wherein thaspecified period is 
no more than approximately fifty milliseconds. 

10. A method in a fiber optic ring network node for for- 
warding data packets on a packet by packet basis, 
the packets being received from another node on 
the fiber optic ring network, comprising: 

receiving a packet; 

examining a label value of the received data 
packet; 

determining a replacement label having a 
replacement label value; and 

forwarding the data packet in one of a plurality 
of paths in the fiber optic ring network accord- 
ing to the replacement label value'. 

1 1 . The method of claim 1 0 further comprising the step 
of replacing a label received in the header of the 
data packet with the replacement label value. 

12. The method of claim 11 wherein the replacement 
label defines a forwarding path route for the data 
packet 

13. The method of claim 12 wherein the node forwards 
the data packet according to the new path route 
information found in the new label. 

14. The method of claim 1 0 further including the step of 
determining to output the data packet through a 
port to an external device rather than to forward the 
received packet onto the fiber optic ring network. 

15. The method of claim 14 further comprising the step 
of converting the received data packet from a TDM 
format to an IP format. 
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generating an error signal onto the fiber optic 
ring network to inform all nodes on the fiber 
optic ring network of the specified failure condi- 
tion. 

1 8. The method of claim 1 7 wherein the adjacent com- 
munication link having the failure condition is down 
stream on the working path and further wherein the 
error signal is transmitted onto a protection path. 

19. The method of claim 1 7 wherein the adjacent com- 
munication link having the failure condition is up 
stream on the working path and further wherein the 
error signal is transmitted onto a working path. 
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20. A method in a fiber optic ring network node for rout- 
ing data packets serving as an ingress node for IP 
user traffic, comprising: 

20 updating a routing/forwarding table based upon 

a detected condition in the fiber optic ring net- 
work; 

setting a label in a data packet being transmit- 
25 ted onto the fiber optic ring network, the label 

having a label value for defining a path route to 
cause the data packets to be routed on the pro- 
tection path; and 

30 forwarding the data packet 

21. The method of claim 20 further comprising the step 
of receiving a signal in a fiber optic network node 
identifying a condition in a communication link 

35 within the network. 

22. The method of claim 20 further comprising the step 
of detecting the condition in an adjacent communi- 
cation link of fiber optic network. 

40 



16. The method of claim 14 further comprising the step 
of converting a plurality of received data packets 
from a TDM format to one IP packet having an IP 
format 
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17. A method in a fiber optic ring network node for for- 
warding data packets, comprising: 

examining all communication links in the fiber 
optic ring network that are adjacent to the node 
for OSI layer 1, layer 2 and layer 3 types of con- 
ditions; 



so 



determining if a specified failure condition has 55 
occurred on any one of the adjacent communi- 
cation links; and 
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